MEMORANDUM January 18, 2018 


TO: Gloria Cavazos 
Chief Human Resources Officer 
FROM: Carla Stevens 


Assistant Superintendent, Research and Accountability 


SUBJECT: TEACH FOR AMERICA PROGRAM EVALUATION, 2017 


Since 1991, Houston Independent School District (HISD) and Teach for America (TFA) have 
maintained a twenty-five year partnership. The primary goal of that partnership is to assist the 
district with filling high priority vacant teaching positions in low-income schools. The purpose of 
this evaluation is to summarize the frequency and effectiveness of TFA corps members in HISD 
from 2012-2013 to 2016-2017. 


Key findings include: 


Since 2012-2013, 36 percent (N=97) of the 267 low-income schools in HISD hired at least 
one TFA corps member for at least one year. TFA corps members have made up ten 
percent or less of the total number of new teachers hired at the beginning of each school 
year. 

Shifting the cost of the annual fee for a TFA teacher from the district to the hiring campus 
appears to have had a limited impact on hiring trends. The number of TFA corps members 
hired in HISD has declined since 2012-2013, with the greatest decrease in TFA teacher 
hires occurring between 2014—2015 and 2015-2016, one year before the budget changes. 
Analysis of the 2015-2016 new teacher cohort showed similar proportions of retained TFA 
and non-TFA teachers with Effective and Highly Effective Instructional Practice ratings in 
their first year of teaching. Though TFA teachers were proportionally rated as more effective 
than non-TFA teachers in their second and third year of teaching, TFA teachers had higher 
turnover rates compared to non-TFA teachers in their third year of teaching and years 
thereafter. 

On the STAAR 3-8 Mathematics exam for 2015, 2016, and 2017, and the STAAR 3-8 
Reading exam for 2017, economically disadvantaged students linked to TFA teachers from 
the 2014-2015 new teacher cohort showed higher student outcomes compared to 
economically disadvantaged students linked to non-TFA teachers from the same teacher 
cohort. 


Further distribution of this report is at your discretion. Should you have any further questions, 
please contact me at 713-556-6700. 
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Teach for America Program Evaluation, 2017 


Executive Summary 


Program Description 

Teach for America is a national organization with a long-established presence in Houston. The organization 
recruits recent college graduates and mid-career professionals who commit to teaching for two years in 
schools with high proportions of economically disadvantaged students (Teach for America, 2017). Since 
1991, Houston Independent School District (HISD) and Teach for America (TFA) have maintained a twenty- 
five year partnership in which TFA assists the district with filling high-priority, vacant teaching positions in 
low-income schools. The purpose of this evaluation is to summarize the frequency and effectiveness of 
TFA corps members in HISD since 2012-2013. 


Highlights 


Since 2012-2013, 36 percent (N=97) of the 267 low-income schools in HISD hired at least one TFA 
corps member for at least one year. TFA corps members have made up ten percent or less of the total 
number of new teachers hired at the beginning of each school year. 


The decision to shift cost of the annual fee for a TFA teacher from the district to the hiring campus 
appears to have had a limited impact on hiring trends. The number of TFA corps members hired in 
HISD has declined since 2012-2013, with the greatest decrease in TFA teacher hires occurring 
between 2014-2015 and 2015-2016, one year before the budget changes. 


For the 2012-2013 new teacher cohort entering their fourth year of teaching, the retention rate for TFA 
teachers was 16 percent (n=20), a decrease of 32 percentage points from the previous year, and a 
difference of 37 percentage points when compared to non-TFA teachers (53%, n=594) from the same 
cohort. Analyses of the 2013-2014 and 2014—2015 new teacher cohorts show similar retention trends 
for TFA teachers entering their fourth year of teaching. 


TFA teachers did not contribute significantly to the proportional diversity of new teacher hires in HISD. 
Across all three new teacher cohorts in 2014-2015, 2015-2016, and 2016-2017, TFA teachers had a 
lower proportion of Hispanic teachers compared to non-TFA teachers. The number of Hispanic TFA 
teachers accounted for one percent of the total proportion of Hispanic new teachers hired for each 
school year. 


Analysis of the 2015-2016 new teacher cohort showed similar proportions of retained TFA and non- 
TFA teachers with Effective and Highly Effective Instructional Practice ratings in their first year of 
teaching. Though TFA teachers were proportionally rated as more effective than non-TFA teachers in 
their second and third year of teaching, TFA teachers had higher turnover rates compared to non-TFA 
teachers in the third year of teaching and years thereafter. 


On the STAAR 3-8 Mathematics exam for 2015, 2016, and 2017, and the STAAR 3-8 Reading exam 
for 2017, economically disadvantaged students linked to TFA teachers from the 2014-2015 new 
teacher cohort showed higher student outcomes compared to economically disadvantaged students 
linked to non-TFA teachers from the same teacher cohort. On the STAAR 3-8 Reading exam for both 
2015 and 2016, economically disadvantaged students linked to TFA teachers performed equally as 
well as economically disadvantaged students linked to non-TFA teachers from the same cohort. 
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Recommendations 


In light of the district’s goal to fill teacher vacancies in critical shortage areas, as well as the contributions 
made by TFA teachers to the education of economically disadvantaged students, particularly in the 
area of mathematics, it may be of interest to the district to further investigate the impact of TFA teachers 
at individual campuses. The district might consider further research to understand why HISD campuses 
have hired TFA teachers for multiple years in order to potentially identify reasons that some principals 
value the district’s partnership with Teach for America. 


Findings show that most TFA corps members hired in the district fulfilled their two-year obligation to 
teach, but the retention of TFA teachers in subsequent years was lower than the retention of non-TFA 
teachers. The district might consider collecting information at the point of exit for all teachers, including 
TFA teachers, or requesting exit data on TFA corps members from Teach for America. It may be 
possible to improve retention for TFA teachers after two years if the district and hiring campuses had a 
better understanding of why these teachers choose to leave. 


For this report, comparisons between teacher groups were limited to TFA and non-TFA teachers by 
cohort year. The district does not currently maintain historical records of individual teacher’s certification 
type (i.e., traditional or alternative) and/or alternative certification program. Because most TFA teachers 
are not certified at the time of hiring, comparisons of TFA teachers with traditionally certified teachers 
and/or other teachers enrolled in alternative certification programs would offer a more comprehensive 
analysis of the longitudinal data. 


Though the majority TFA teachers have been shown to be effective in the classroom, especially during 
the second year of teaching, findings from this report provide evidence of greater upfront costs and 
higher turnover rates over time for TFA teachers compared to non-TFA teachers. Because the district 
already invests heavily in the recruitment, preparation, and support of novice teachers through internal 
efforts, HISD leadership may want to assess the salience of a longstanding partnership that was 
originally established to help the district fill high-priority, vacant teaching positions. 
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Introduction 


Houston Independent School District (HISD) and Teach for America (TFA) have maintained a twenty-five 
year partnership aimed at assisting the district to fill high-priority, vacant positions in low-income schools. 
Teach for America recruits recent college graduates and mid-career professionals across the nation 
whocommit to two years of teaching in schools with high proportions of economically disadvantaged 
students (Teach for America, 2017). 


TFA teachers, also known as corps members, receive a variety of training and supports. Before they are 
hired by a school, corps members receive summer training for five weeks from Teach for America Houston, 
which covers subjects including general teaching pedagogy, classroom management, and diversity, equity, 
and inclusiveness (Teach for America, 2017). Additional information about TFA training can be found in 
Appendix A (pp. 17—18). Most corps members do not enter TFA with a teaching certification, and therefore 
enroll in an alternative certification program (ACP) during their two-year commitment. The majority of TFA 
corps members hired in HISD are certified through the Effective Teaching Fellowship (ETF)', the district’s 
ACP for uncertified, novice teachers (TFA, personal communication, October 6, 2017). TFA teachers also 
participate in regular sessions offered through Teach for America Houston in areas including restorative 
justice, leadership development, and education policy during their two years in the classroom, ultimately 
gaining access to a “powerful network” of alumni “across all sectors influencing the future of our country” 
(Teach for America, 2017). Essentially, TFA teachers in HISD receive training and support from both TFA 
and ETF, with most corps members obtaining their teaching certification prior to, or by the end of, their two- 
year service commitment. 


Teach for America requires the hiring district to pay a non-refundable, annual fee per corps member per 
year. TFA reports that these fees are used to offset the high cost of recruiting and training quality teachers.” 
In HISD, the annual fee of a TFA teacher was historically paid through the district budget. However, 
beginning in 2016-2017, the responsibility of paying the annual fee per TFA teacher shifted to the hiring 
campus’, with the school paying $5,000/year per teacher in a critical shortage area and $3,000/year per 
teacher in a non-critical shortage area. In addition to the annual fee, the hiring campus also paid other costs 
of the teacher, including salary and additional training or supports. 


Teach for America has garnered different sentiments regarding both the effectiveness of TFA teachers and 
the value of TFA in school districts with teacher shortages and constrained budgets. Nationally, numerous 
studies have been conducted assessing the impact of TFA corps members, exploring topics like student 
achievement and growth on standardized assessments, diversity of TFA corps members, the utility of using 
TFA to address local teacher shortages, and teacher retention. The findings from these studies have been 
largely mixed, with both advocates and critics citing data to support their respective views of TFA. An 
overview of studies on TFA can be found in Appendix B (pp. 19-20). 


A 2011 program evaluation of TFA in HISD analyzed hiring trends, retention rates, and student performance 
data for TFA teachers from 2006 through 2010 (HISD Research and Accountability, 2011). While most TFA 
corps members fulfilled their two-year obligation to teach, the retention of TFA teachers over time was 


' New teachers enrolled in the Effective Teaching Fellowship (ETF) participate in 30 hours of pre-service training. Throughout the one- 
to two-year internship, teachers are expected to accumulate 300 hours of professional development, while also receiving instructional 
support and coaching from HISD content specialists (HISD Teacher Development, 2017). 

? According to Teach for America Houston, the cost per corps member to pay for recruitment, training, and development during the 
two-year commitment amounts to nearly $51,000 (TFA, personal communication, October 6, 2017). 

3 Teach for America Houston aims to place their teachers in low-income HISD schools with at least 70 percent of the student population 
identified as economically disadvantaged (TFA, personal communication, October 6, 2017). 
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worse when compared to non-TFA teachers. Review of the retention rates of the 2005-2006 cohort found 
that only nine percent of TFA teachers, compared to 44 percent of non-TFA teachers, returned for their 
sixth year of teaching. When comparing student performance outcomes for TFA and non-TFA teachers in 
the 2008-2009 new teacher cohort, students of TFA teachers passed the Texas Assessment of Knowledge 
and Skills (TAKS) in mathematics at higher rates than students of non-TFA teachers in both 2009 and 2010. 
However, no difference was found for the 2009 and 2010 TAKS results in the subject areas of reading, 
science, and social studies in between groups or across years. 


Recent conversations about TFA in the district have raised issues like diversity and retention. In 2015, 
HISD’s Chief Human Resources Officer cited the partnership with TFA as one of several strategies to recruit 
more Hispanics in HISD, a proposal that aligned with TFA’s 2015 pledge to recruit Latinos in response to a 
call to action from the White House Initiative on Educational Excellence for Hispanics (Houston ISD, 2015; 
Teach for America, 2015). The following year, the HISD Leadership Profile Report for the incoming 
superintendent presented leaders’ concerns regarding the investment of financial resources to hire and 
retain highly effective teachers in struggling schools (Hazard, Young, Attea, & Associates, 2016). The report 
cited that a reoccurring theme across focus groups was the low attrition rates of TFA teachers beyond the 
two-year commitment to teaching. Given the frequency of conversations around HISD’s partnership with 
TFA and the considerable amount of time that has passed since the last program evaluation, a recent HISD 
report (HISD Research and Accountability, 2017) recommended an updated evaluation showing 
employment trends and effectiveness of TFA teachers in the district. 


The purpose of this evaluation is to summarize the frequency and effectiveness of TFA corps members in 
HISD. First, TFA and non-TFA teachers are presented by teacher hiring and retention rates across five 
years from 2012-2013 through 2017-2018. This report then summarizes the jobs of TFA corps members 
hired in 2012-2013 through 2015-2016 currently employed in HISD at the beginning of the 2017-2018 
school year, beyond the two-year commitment to TFA. This report then presents new TFA and non-TFA 
teachers by demographics and district placement for new teacher cohorts from 2014-2015 through 2016— 
2017. Student performance data on the STAAR 3-8 Reading and Mathematics exams are presented across 
three years for students identified as economically disadvantaged or gifted and talented and linked to the 
2014-2015 new teacher cohort. Finally, this report summarizes a sample of principal responses on a short 
survey conducted by HISD Human Resources (HR) Recruitment and Selection regarding overall interest in 
hiring TFA teachers for the upcoming 2017-2018 school year. 


Methods 


Data Collection 

For this report, Teach for America (TFA) teachers, or corps members, refer to teachers hired through TFA. 
Non-TFA teachers refer to teachers not hired through TFA. A new teacher cohort refers to all teachers in 
their first year of teaching hired to work in the district. Both TFA and non-TFA teacher groups include 
teachers certified through alternative certification programs (ACPs) and traditional certification programs. 


e TFA teacher cohort files present the number of TFA corps members who appear on corps member 
rosters provided by Teach for America Houston. In some years, not all corps members on a roster 
remained in the district long enough for adequate data to be collected. While the counts of TFA corps 
members hired are presented in Figure 1 (p. 6) of this report, the following data represent only TFA 
teachers that remained in the district long enough for data to be compiled. In 2012-2013, 125 TFA 
teachers were hired, but 123 teachers were identified in the HR Roster File. In 2014-2015, 102 TFA 
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teachers were hired, but 101 teachers were identified in the HR Roster File. In 2016-2017, 39 TFA 
teachers were hired, but 38 teachers were identified in the HR Roster File. 


HISD Human Resources (HR) provided district-wide employee rosters, which included multiple 
identifiers for teacher level data. Teachers were identified using the following criteria: 
o To identify job descriptions specific to teachers, the variable Job Function Code was reported as 
TCH, TEA ELEM, TEA PREK, or TEA SEC. 
o To identify salary plans specific to teachers, the variable Salary Plan was reported as RT, VT, 
RO1 or ROS. 


New teachers, verified by the Human Resources Information System (HRIS), were identified as full- 
time teachers with zero (or #) years of total HISD and other teaching experience for each school year. 


Critical shortage teachers for 2014-2015 and 2015-2016 were in the following areas: Bilingual/English 
as a Second Language, Career and Technical Education, Computer Science, Mathematics, Science, 
and Special Education. Critical shortage teachers for 2016-2017 were in the following areas: 
Bilingual/English as a Second Language, Career and Technical Education, Computer 
Science/Technology Applications, Mathematics, Science, and Special Education (U.S. Department of 
Education, 2016a). 


This report presents the percentage of students performing at or above the Approaches Grade Level 
Standard and at the Masters Grade Level Standard on the State of Texas Assessments of Academic 
Readiness (STAAR 3-8) Reading and Mathematics exams for 2015, 2016, and 2017 for students taught 
by TFA and non-TFA teachers from the 2014-2015 new teacher cohort. The ASPIRE (Accelerating 
Student Progress: Increasing Results and Expectations) team, housed within the HISD Department of 
Research and Accountability, provided student-teacher linkage across three years 2015, 2016, and 
2017, for students taught by teachers in the 2014-2015 new teacher cohort. 


Limitations 


HISD Human Resources (HR) collects and manages data for district teachers regarding alternative 
certification program, university/college major, degree type, and teaching years of experience. In most 
cases, these data are self-reported by the teacher within the first few months of hiring. As a result, data 
not submitted by the teacher at the time of the data extraction may not be captured in this report. 
Consequently, newly-hired HISD teachers, while incentivized to report years of experience for salary 
purposes to the district, may not have reported previous experience and would be incorrectly counted 
as a new first-year teacher in this report. 


For this report, comparisons between teacher groups were limited to TFA and non-TFA teachers by 
cohort year. HISD HR does not currently maintain historical records of individual teacher’s certification 


type (i.e., traditional or alternative) and/or alternative certification program. 


Results 


What was the frequency of TFA teachers hired from 2012-2013 to 2016-2017? 


Figure 1 (p. 6) displays the number of TFA teachers hired annually from 2012-2013 to 2016-2017 and 
the number of schools that hired TFA teachers each year. While the number of TFA corps members 
hired in HISD has declined since 2012-2013, the greatest decrease occurred between 2014-2015 and 
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2015-2016, when the number of TFA corps members hired in HISD fell 52 percent from 102 to 49 
teachers. 


e Since 2012-2013, 36 percent (N=97) of the 267 low-income schools in HISD hired at least one TFA 
corps member for at least one year. See Table C-1 in Appendix C (pp. 21—22) for more detail. Annually, 
the total number of hiring schools has ranged from 49 schools in 2012-2013 to 21 schools in 2016- 
2017. 


Figure 1. Hiring Trends of Teach for America Teachers in HISD, 2012-2013 through 2016-2017 
150 
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Sources: TFA Cohort File 2012-2013, 2013-2014, 2014-2015, 2015-2016, 2016-2017 
Note: Beginning in 2016-2017, second year corps members hired in 2015-2016 were paid by the district budget 
and first year corps members hired in 2016-2017 were paid by the campus budget from the hiring school. 


e Of the schools that have hired at least one TFA corps member since 2012-2013, nine schools hired at 
least one TFA teacher for four out of the five years, and two schools hired at least one TFA teacher five 
out of five years. See Table C-1 in Appendix C (pp. 21-22). 


e Table 1 shows the frequency and proportion of TFA and non-TFA new teachers hired across five years. 
From 2012-2013 to 2016-2017, a total of 415 new TFA corps members were employed in HISD 
schools.* 


Table 1. Total Number of New Teachers Employed in HISD, 2012-2013 through 2016-2017 


School Year TFA Non-TFA Total New Total 
(Cohort Year) Teachers Teachers Teachers Teachers 
N % of new N % of new N % of total N 
teachers teachers teachers 
2012-2013 123* 10% 1,123 90% 1,246 11% 11,355 
2013-2014 104 8% 1,266 92% 1,370 12% 11,861 
2014-2015 101* 8% 1,212 92% 1,313 11% 11,847 
2015-2016 49 4% 1,185 96% 1,234 10% 11,910 
2016-2017 38* 4% 889 96% 927 8% 11,785 


Sources: HR Roster File 2012-2013, 2013-2014, 2014-2015, 2015-2016, 2016-2017; and TFA Cohort File, 2012-2013, 2013-2014, 
2014-2015, 2015-2016, 2016-2017 
Notes: *In 2012-2013, 2014-2015, and 2016-2017, the number of teachers hired did not match the number of teachers employed as 
of November 1 of the respective year. 


+ In some years, not all corps member on a roster remained in the district long enough for adequate data to be collected. After Figure 
1 (p. 6), the data represent only TFA teachers that remained in the district long enough for data to be compiled. 
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Since 2012-2013, TFA corps members have made up ten percent or less of the total number of new 
teachers employed in the district. In both 2015-2016 and 2016-2017, TFA teachers accounted for only 
four percent of the total new teachers hired for each respective school year (Table 1, p. 6). 


How did TFA teachers compare to non-TFA teachers relative to retention rates from 2012-2013 to 
2016-2017? 


Figure 2 presents the retention rates of new teacher cohorts from 2012-2013 to 2016-2017. See Table 
D-1 in Appendix D (p. 23) for more detail. Since 2012-2013, with the exception of 2016-2017, the 
retention rate for the new teacher cohorts entering their second year of teaching was at least four 
percentage points higher for TFA teachers compared to the non-TFA teachers. In 2016-2017, the 
retention rate for TFA teachers entering their second year of teaching was seven percentage points 
lower than non-TFA teachers from the same cohort (66% compared to 73%). 


Figure 2. Teacher Retention Rates Across Years for New Teacher Cohorts, 2012-2013 through 
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Sources: HR Roster File 2012-2013, 2013-2014, 2014-2015, 2015-2016, 2016-2017; and TFA Cohort File, 2012-2013, 2013-2014, 


2014-2015, 2015-2016, 2016-2017 


from their school of hire are not captured in this graph. 


For teachers entering their third year of teaching, the retention rate for non-TFA teachers was higher 
compared to TFA teachers. The greatest proportional difference in retention rates for teachers entering 
their third year was observed in the 2012-2013 new teacher cohort. As of September 2014, the 
retention rate for TFA teachers hired in the 2012-2013 school year was 17 percentage points lower 
that non-TFA teachers hired that same year (48% compared to 65%). 


For the 2012-2013 new teacher cohort entering their fourth year of teaching, the retention rate for TFA 
teachers was 16 percent, a decrease of 32 percentage points from the previous year (48%), and a 
difference of 37 percentage points when compared to non-TFA teachers (53%) from the same new 
teacher cohort. For this same cohort, as of September 2017, the retention rate for TFA teachers 
entering their sixth year of teaching was seven percent (n=8) compared to 37 percent (n=413) for non- 
TFA teachers. 
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After the two-year commitment to TFA, how many TFA alumni were employed at the beginning of 
the 2017-2018 school year? 


e Figure 3 shows the job positions for TFA alumni working in HISD as of September 2017 after 
completing their two-year commitment to Teach for America. Of the TFA cohorts presented in this 
report, the cohorts from 2012-2013, 2013-2014, 2014-2015, and 2015-2016 had completed their two- 
year commitment prior to the start of the 2017-2018 school year. Of the 377 teachers employed in 
HISD from these four cohorts, 24 percent (N=90) were working for the district as of September 2017. 
This count includes both teachers that were consecutively retained (Table D-1, p. 23) and teachers that 
may have left the district and later returned. 


Figure 3. Positions of TFA Alumni Employed in HISD as of September 2017 
from 2012-2013, 2013-2014, 2014-2015, & 2015-2016 Cohorts (N=90) 
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Sources: HRIS Roster File, October 2017; TFA Cohort File 2012-2013, 2013-2014, 2014-2015, 
and 2015-2016 
Note: *The teacher count includes both teachers that were consecutively retained (n=70) (Table D-1, 
p. 23) and teachers that may have left the district and later returned (n=7). 


e Of the 90 TFA alumni employed at the beginning of the 2017-2018 school year, 86 percent (n=77) 
were working as teachers beyond the two-year commitment required by TFA. In other words, of the 
380 TFA teachers hired to work for HISD between 2012-2013 and 2015-2016, 18 percent (n=70) were 
consecutively retained as teachers and two percent (n=7) left the district and later returned as teachers. 


e By the beginning of the 2017-2018 school year, 11 percent (n=10) of TFA teachers who had completed 
their two-year commitment had transitioned to leadership or support positions within the district. That 
is, of the 380 TFA teachers hired to work for HISD between 2012-2013 and 2015-2016, three percent 
(n=10) transitioned to other roles as Instructional Specialists/Coordinators, Assistant Principals/Deans, 
or positions in School Support Services. 


What were the demographic characteristics of TFA teachers compared to non-TFA teachers from 
2014-2015 to 2016-2017? 


e Figure 4 (p. 9) presents the ethnic/racial composition of new teacher cohorts in 2014-2015, 2015-— 
2016, and 2016-2017. Additional information regarding race/ethnicity, gender, and level of education 
for new teacher cohorts can be found in Table D-2, Appendix D (p. 24). For the 2016-2017 new teacher 
cohort, TFA teachers had a higher proportion of Asian and African American teachers compared to 
non-TFA teachers (13% compared to 7%, and 36% compared to 31%, respectively). 
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e With the exception of 2015-2016, TFA teachers had a higher proportion of African American teachers 
compared to non-TFA teachers. For the 2015-2016 new teacher cohort, the proportion of African 
American TFA teachers was seven percentage points lower than the proportion of African American 
non-TFA teachers (27% compared to 34%). 


e Across all three new teacher cohorts, 2014-2015, 2015-2016, and 2016-217, TFA teachers had a 
lower proportion of Hispanic teachers compared to non-TFA teachers. For the 2014-2015 new teacher 
cohort, for example, the proportion of Hispanic TFA teachers was eight percentage points lower than 
the proportion of Hispanic non-TFA teachers (18% compared to 26%). 

Figure 4. Ethnic/Racial Diversity Across Years for New Teacher Cohorts, 2014-2015 through 
2016-2017 
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Sources: HR Roster File 2014-2015, 2015-2016, 2016-2017; PEIMS Roster File 2014-2015, 2015-2016, 2016-2017; and 
TFA Cohort File, 2014-2015, 2015-2016, 2016-2017 
Note: Percentages may not equal 100 due to rounding 


e Across all three new teacher cohorts, 2014-2015, 2015-2016, and 2016-217, the number of Hispanic 
TFA teachers accounted for one percent of the new teachers for the year (n=18, n=10 and n=8, 
respectively). (Table D-2, Appendix D, p. 24). 


What was the district’s placement of TFA teachers compared to non-TFA teachers from 2014-2015 
to 2016-2017? 


e Figure 5 (p. 10) shows the placement of TFA and non-TFA teachers from new teacher cohorts by the 
percentage of economically disadvantaged students at a school. Additional information for new teacher 
cohort placement by percent economically disadvantaged, school accountability rating, critical shortage 
area, school level, and student population can be found in Table D-3, Appendix D (p. 25). Across all 
three new teacher cohorts, the proportion of TFA teachers placed at schools with at least 70 percent of 
the student population identified as economically disadvantaged was higher compared to the proportion 
of non-TFA teachers. For the 2016-2017 new teacher cohort, for example, the proportion of TFA 
teachers placed at high poverty schools was 17 percentage points higher than the proportion of non- 
TFA teachers (97% compared to 80%). 
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Figure 5. Placement by School Percentage Economically Disadvantaged Students for New 
Teacher Cohorts, 2014—2015 through 2016-2017 
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e Across all three new teacher cohorts, 2014-2015, 2015-2016, and 2016—217, the proportion of TFA 
teachers placed at schools with at least 90 percent of the student population identified as economically 
disadvantaged was higher compared to the proportion of non-TFA teachers. The number of TFA 
teachers placed at schools with at least 90 percent of the student population identified as economically 
disadvantaged accounted for three percent or less of the new teachers hired for the year (n=33, n=30, 
and n=21, respectively) (Table D-3, Appendix D, p. 25). 


Figure 6. Placement by Critical Shortage Assignment for New Teacher 
Cohorts, 2014-2015 through 2016-2017 
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Figure 6 (p. 10) presents the placement of TFA and non-TFA teachers from new teacher cohorts by 
critical shortage assignment. See Table D-3 Appendix D (p. 25) for more detail. In both 2015-2016 and 
2016-2017, a higher proportion of TFA teachers were assigned to teach in critical shortage areas (43% 
and 53%, respectively) compared to the proportion of non-TFA teachers (37% and 39%, respectively). 


Across all three new teacher cohorts, 2014-2015, 2015-2016, and 2016-217, the number of TFA 
teachers assigned to critical shortage areas accounted for three percent or less of the new teachers for 
the year (n=35, n=21 and n=20, respectively) (Table D-3, Appendix D, p. 25). 


How did TFA teachers compare to non-TFA teachers in terms of teacher effectiveness from 2014— 
2015 to 2016-2017? 


Figure 7 shows new teacher cohorts by TFA and non-TFA teachers from 2014-2015 to 2016-2017 
across three years by Effective and Highly Effective Instructional Practice (IP) ratings.5 See Table D-4 
in Appendix D (p. 26) for more detail. Further explanation of the Instructional Practice Component of 
the Teacher Appraisal and Development System (TADS) can be found in Table E-1 in Appendix E (p. 
27). For the 2014—2015 new teacher cohort retained for the 2015-2016 school year, 63 percent of TFA 
(n=50) and 64 percent non-TFA teachers (n=569) received an Effective IP rating in their first year of 
teaching. There were no TFA teachers that received a Highly Effective rating in their first year of 
teaching, while four percent of non-TFA teachers (n=35) received a Highly Effective rating. 


Figure 7. Instructional Practice Ratings of Teachers Retained Annually Across Years for New 
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For the 2014-2015 new teacher cohort retained for the 2016-2017 school year, the proportion of TFA 
teachers rated Effective or Highly Effective (n=43) during their second year of teaching was 11 
percentage points higher than the proportion of non-TFA teachers (n=591) (94% compared to 83%). 
The following year, for the 2014-2015 new teacher cohort retained for the 2017-2018 school year, the 
proportion of TFA teachers rated Effective or Highly Effective (n=25) during their third year of teaching 


5 Over the course of the school year, appraisers observe teachers to provide useful feedback intended to improve teaching practices 
and support the teacher in curriculum planning and professional development through the TADS system (HISD Performance 
Management, 2013). Appraisers assign scores to the teachers for whom they are responsible using standardized rubrics. Appraisers 
use the Instructional Practice rubric to assess a teacher’s skills and ability to promote learning through classroom observations and 
walkthroughs. 
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was 11 percentage points higher than the proportion of non-TFA teachers (n=485) (100% compared to 
89%) (Figure 7, p. 11). 


e For the 2015-2016 new teacher cohort retained for the 2016-2017 school year, 61 percent of TFA 
(n=23) and 60 percent non-TFA teachers (n=523) received an Effective IP rating in their first year of 
teaching, while the proportion of TFA teachers rated Highly Effective (n=1) was four percentage points 
lower than the proportion of non-TFA teachers (n=62) (3% compared to 7%). The following year, for 
the 2015-2016 new teacher cohort retained for the 2017-2018 school year, the proportion of TFA 
teachers rated Effective or Highly Effective (n=16) during their second year of teaching was 18 
percentage points higher than the proportion of non-TFA teachers (n=427) (85% compared to 67%). 


e For the 2016-2017 new teacher cohort retained for the 2017—2018 school year, the proportion of TFA 
teachers rated Effective (n=16) in their first year of teaching was four percentage points lower than the 
proportion of non-TFA teachers (n=441) (64% compared to 68%). That same year, eight percent of 
TFA (n=2) and six percent of non-TFA teachers (n=40) from the 2016-2017 new teacher cohort 
received a Highly Effective IP rating in their first year of teaching. 


What was the academic performance of students taught by TFA teachers compared to the academic 
performance of students taught by non-TFA teachers from 2014-2015 to 2016-2017? 


e Table 2 presents the academic performance of economically disadvantaged students on the STAAR 
3-8 Reading and Mathematics exams linked to TFA and non-TFA teachers in the 2014-2015 new 
teacher cohort across three years. For the 2015 and 2016 STAAR 3-8 Reading tests, the percent of 
economically disadvantaged students at or above Approaches Grade Level Standard was statistically 
similar for new teachers, regardless of the TFA or non-TFA identification. 


Table 2. STAAR 3-8 Results for Economically Disadvantaged Students Taught by 2014-2015 New Teachers (TFA and Non-TFA), 2014-2015 


through 2016-2017 
TFA New Teacher 
n=101 


Non-TFA New Teachers 
n=1,212 


Reading 3-8 2015 58% 57% 8% 0.26 


2016 57% 59% 11%* 
69%** 60%** 13% 
Mathematics 3-8 61%** 6% 52%** 5% 


68%** 14%** 61%** 10%** 


80%** 20%* 66%** 15%* 


Sources: PEIMS Roster File 2014-2015, 2015-2016, 2016-2017; TFA Cohort File, 2014-2015, 2015-2016, 2016-2017, ASPIRE Teacher 
Linkage File,2014-2015, 2015-2016, 2016-2017; TEA-ETS STAAR 3-8 Student Data Files, 2014-2015, 2015-2016, 2016-2017 
Notes: Results for STAAR 2015, 2016, and 2017 exclude the Alt 2 test version. 
*p<0.05, **p<0.01. 


e On the subsequent 2017 STAAR 3-8 Reading test, the proportion of economically disadvantaged 
students performing at or above the Approaches Grade Level Standard was nine percentage points 
higher for students linked to TFA teachers (69%) that were retained as teachers in HISD beyond the 
two-year commitment compared to students linked to non-TFA teachers (60%). 
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e On the STAAR 3-8 Mathematics test across all three years, 2015, 2016, and 2017, the proportion of 
economically disadvantaged students performing at or above the Approaches Grade Level Standard 
was higher for students linked to TFA teachers compared to students linked to non-TFA teachers. For 
TFA teachers in their first year of teaching, the proportion of their students at or above Approaches 
Grade Level Standard (61%) was nine percentage points higher compared to students linked to non- 
TFA teachers (52%) in their first year of teaching (Table 2, p. 12). 


e For students linked to TFA teachers that were retained as teachers in HISD beyond the two-year 
commitment, 80 percent performed at or above the Approaches Grade Level Standard on the 2017 
STAAR 3-8 Mathematics test, 14 percentage points higher than the proportion of economically 
disadvantaged students linked to non-TFA teachers in their third year of teaching (66%). 


e Table 3 presents the academic performance of gifted and talented (GT) students on the STAAR 3-8 
Reading and Mathematics exams linked to TFA and non-TFA teachers in the 2014-2015 new teacher 
cohort across three years. On both the STAAR 3-8 Reading and Mathematics exams for school years 
2015, 2016, and 2017, the proportion of GT students performing at or above the Approaches Grade 
Level Standard was statistically similar for TFA and non-TFA teachers. 


Table 3. STAAR 3-8 Results for Gifted and Talented Students Taught by 2014-2015 New Teachers (TFA and Non-TFA), 2014-2015 through 
2016-2017 
TFA New Teacher Non-TFA New Teachers 
n=101 n=1,212 


% At or 
%Ator | i N % At or eR Ae 
Above /|%Masters te Ps are students | Above (|%Masters eee 2 erie 
tested Approaches| | ; tested Approaches eset P 
208 


42%** 


Reading 3-8 2015 


132 52%** 


67 55%** 


Mathematics 3-8 


Sources: PEIMS Roster File 2014-2015, 2015-2016, 2016-2017; TFA Cohort File, 2014-2015, 2015-2016, 2016-2017, ASPIRE Teacher 
Linkage File,2014-2015, 2015-2016, 2016-2017; TEA-ETS STAAR 3-8 Student Data Files, 2014-2015, 2015-2016, 2016-2017 
Notes: Results for STAAR 2015, 2016, and 2017 exclude the Alt 2 test version. 
*p<0.05, **p<0.01. 


e On the STAAR 3-8 Reading exam across all three years, 2015, 2016, and 2017, the proportion GT 
students performing at the Masters Grade Level Standard was lower for students who were linked to 
TFA teachers compared to students linked to non-TFA teachers. For TFA teachers in their first year of 
teaching, the proportion of their GT students performing at the Masters Grade Level Standard was 15 
percentage points lower compared to students linked to non-TFA teachers in their first year of teaching 
(27% compared to 42%). 
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What was principals’ interest in hiring TFA teachers for the 2017-2018 school year? 


e In January 2017, HISD Human Resources Department conducted a brief survey to gauge the interest 
of principals eligible to hire a TFA corps member in the 2017-2018 school year. See Appendix F (p. 
28) for more detail. Of the 229 principals invited to participate, 20 percent responded (N=46) to the 
survey. Three principals identified themselves as TFA alumni. 


e Of the respondents, 50 percent of principals (n=23) reported that they had hired a TFA corps member 
to teach at their school in previous years. However, with the responsibility of paying the annual fee for 
a TFA member shifting to the hiring campus, 11 of the principals, almost half of those who had 
previously hired a TFA corps member, said they would not hire a corps member in the future. 


e Overall, with the budget changes, 41 percent of all respondents (n=19) reported that they would still 
hire a TFA corps member in the future. 


Discussion 


This report was intended to evaluate the Teach for America program in HISD from 2012-2013 to 2016-— 
2017. Since 2012-2013, a total of 415 new TFA corps members were employed in 97 different low-income 
schools in the district. 


The change of requiring the hiring campus to pay the annual fee for a TFA teacher appears to have had a 
limited impact on hiring trends. Multiple HISD employees have mentioned that they suspect the decrease 
in the number of TFA corps members hired may be associated with shifting the cost to campuses. As one 
principal reported, “Although [it is] hard to staff [our] campus, our extreme budgeting limitations makes it 
difficult to utilize programs such as TFA." However, the greatest decrease in district-wide TFA hires 
occurred one year before the budget changes. Moreover, despite a higher fee for a TFA teacher in a critical 
shortage area compared to a non-critical shortage area, the proportion of TFA teachers in critical shortage 
areas has increased by 18 percentage points since 2014—2015. In light of the district's need for teachers in 
critical shortage areas, as well as the contributions by TFA teachers to the education of economically 
disadvantaged students, particularly in the area of mathematics, it may be of interest to the district to 
investigate the impact of TFA teachers at individual campuses in order to identify reasons that some 
principals in HISD value the district's partnership with Teach for America. 


Findings for TFA teacher retention rates were similar to those in the 2011 report (HISD Research and 
Accountability, 2011). TFA corps members fulfilled their two-year obligation to teach, but the retention of 
TFA teachers in subsequent years was lower than the retention of non-TFA teachers. For each new teacher 
cohort in HISD since 2012-2013, nearly half of TFA teachers remained in the classroom after their two- 
year commitment for a third year, but TFA teacher turnover increased substantially in the fourth year. Teach 
for America Houston, which supports both area public and charter schools, asserts that their teachers often 
serve schools beyond the two-year teaching commitment, citing numerous examples of TFA alumni that 
have gone on to hold leadership roles in the district or founded educationally-based organizations 
supporting low-income students (Teach for America, 2017). In HISD, of the teachers hired between 2012- 
2013 and 2015-2016 who had completed their two-year commitment, three percent transitioned to support 
or leadership roles. It may be possible to improve retention for TFA teachers after two years if the district 
and hiring schools had a better understanding of why these teachers choose to leave. The district might 


5 In 2016-2017, schools with at least 70 percent of their students identified as economically disadvantaged were eligible to hire a TFA 
corps member. 
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consider collecting information at the point of exit for all teachers, including TFA teachers, or requesting 
exit data on TFA corps members from Teach for America. 


The data suggests that TFA and non-TFA teachers have been similarly diverse in the new teacher cohorts 
since 2014-2015. Across all three new teacher cohorts in 2014-2015, 2015-2016, and 2016-2017, TFA 
teachers had a lower proportion of Hispanic teachers compared to the proportion of non-TFA teachers. The 
number of Hispanic TFA teachers accounted for only one percent of the total proportion of Hispanic new 
teachers hired for each school year. Although TFA teachers had a higher proportion of African-American 
teachers compared to the proportion of non-TFA in the 2014-2015 and 2016-2017 school years, the 
number of African American TFA teachers accounted for one to three percent of the total proportion of 
African American new teachers hired for each school year. Because there was such a small number of TFA 
recruits hired each year, TFA teachers did not contribute significantly to the proportional diversity of new 
teacher hires and did not appear to bolster the recruitment of Latino teachers. 


Longitudinal analyses of teacher effectiveness measured by Instructional Practice (IP) ratings seem to 
support some principals’ concerns around hiring TFA teachers. As one principal explained, "We have had 
some good luck and some bad with our TFA corps members. Even ones that turned out really well had 
very rough beginnings and took much coaching (as most beginning teachers do). However, it is rare to 
have one that stays in education in the classroom.” Analysis of retained TFA and non-TFA teachers showed 
similar proportions of teachers with Effective and Highly Effective IP ratings in their first year of teaching. 
Conversely, in their second year, a higher proportion of retained TFA teachers were identified as effective 
in the classroom, compared to the proportion of non-TFA teachers from the same cohort. And while 100 
percent of retained TFA teachers from the 2014-2015 new teacher cohort were rated as Effective or Highly 
Effective in their third year of teaching, only 89 percent of non-TFA teachers reached that same standard. 
However, only 25 percent of the 101 TFA teachers, compared to 45 percent of the 1,212 non-TFA teachers, 
continued to teach at their hiring campuses. Though TFA teachers were proportionally rated as more 
effective than their non-TFA counterparts in their second and third year of teaching, TFA teachers had 
higher turnover rates than non-TFA teachers after their third year of teaching. 


The results comparing the academic performance of students on the STAAR 3-8 Reading and Mathematics 
exams by TFA and non-TFA teachers for the 2014-2015 new teacher cohort were mixed. Economically 
disadvantaged students linked to TFA teachers outperformed students assigned to non-TFA teachers on 
STAAR 3-8 Mathematics exams in 2015, 2016, and 2017. For the STAAR 3-8 Reading exam, there were 
no differences between students by TFA or non-TFA teacher groups for students performing at or above 
the same level in 2015 and 2016. Analysis of gifted and talented (GT) students assigned to the teachers in 
the 2014-2015 cohort indicated that the academic performance of these students by TFA and non-TFA 
groups was nearly similar on the 2015, 2016, and 2017 STAAR 3-8 Reading and Mathematics exams. 
However, GT students linked to non-TFA teachers outperformed at the Masters Grade Level Standard on 
the 2015, 2016, and 2017 STAAR 3-8 Reading exams. These findings suggest that there may be other 
factors impacting student achievement that are not addressed in differences between TFA and non-TFA 
new teachers, such as being highly qualified in STEM subjects or obtaining a teaching certification prior to 
teaching in the classroom. Additional research comparing TFA teachers to a similar teacher group, like 
teachers enrolled in HISD’s alternative certification program, is recommended. However, because most 
TFA teachers leave the district after two years, longitudinal analysis of these groups would likely provide 
limited results. 


Though the majority of TFA teachers have been shown to be effective in the classroom, especially during 
the second year of teaching, findings from this report provide evidence of greater upfront costs and higher 
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turnover rates over time for TFA teachers compared to non-TFA teachers. Because the district invests 
heavily in the recruitment, preparation, and support of novice teachers through internal efforts (e.g., hiring 
events, a district ACP, and competitive compensation programs), HISD leadership may want to assess the 
salience of a longstanding partnership that was originally established to help the district fill high-priority, 
vacant teaching positions. 
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Appendix A: Teach for America — Houston, Excerpts from the Professional 
Development Overview and Guide, 2017-2018 


The following is an excerpt from the 2017-2018 Professional Development and Guide, distributed by Teach 
for America Houston to incoming TFA corps members. Portions of the guide have been omitted from this 
report. None of the text provided in this report has been changed in any way. 


PART ONE: TLD Grounding Vision and Texts: 
VISION: We aspire for all Houston students to thrive academically, develop critical consciousness, and ultimately 
create more just systems of opportunity for themselves and their communities. 


MISSION: We develop leaders who: transform classrooms, create ecosystems of support for students, and become 
change agents in the city of Houston and beyond. 


TEACHING AS LEADERSHIP (TAL)- HOUSTON FRAMEWORK: The following framework is used to help staff, corps 
members, students, and partners to set and support a strong vision of excellence in TFA-Houston classrooms. 
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PART TWO: Our Approach to Professional Development 

APPROACH: 

At Teach For America-Houston we believe... 
.. that teaching is a craft that must be constantly honed. You have chosen, whether for two years or longer, 
to enter the profession of teaching. Great teachers never stop learning about becoming more effective 
practitioners of their chosen craft. 


.. that busy teachers need choice and transparency in how they hone that craft. Our PDS system is designed 
around the belief we should be transparent about the practices of our most effective teachers and that you 
should have choices of when to engage with development. This includes being clear about the scope and 
sequence of development over time in the areas of content, culture of achievement, and diversity. 


... that student experience is at the heart of our work. As a teacher, it is your responsibility not just to attend 
professional development, but to put what you learn into practice, in order to ensure that your students 
thrive academically, develop critical consciousness, and ultimately create more just systems of opportunity. 


STRUCTURES: In support of our approach and outcomes listed above, a 1CM can expect to receive support from TFA- 
Houston in the following ways. It is important to understand that during their first year teaching, a CM will also receive 
support from their campus and certification partner. What that support looks like will vary by partner. 


Ongoing Coaching 


Professional Development System 


Sessions and Experiences in 
themselves will not create 
change. Change comes from 
follow up action, reflection 
and accountability which will 
occur in your ongoing 
partnership with your 
Manager of Teacher 
Leadership Development 
(MTLD). 


PN @reyg osm ere jual-dal alas 


90-120 minute evening 
choice sessions allow CMs to 
zoom into a specific "teacher 
move" that they can add to 
their toolkit that will help 
enable them to reach strong 
student outcomes and the 
regional priorities. These are 
evening sessions that CMs 
can self select into. 


Add'tl Opportunities 


Saturday gatherings allow 
our entire corps a chance to 


connect and build community | _ Corps Member Leadership 
with each other. Council 


Gatherings also provide an 
opportunity to think big 
picture about our classroom 
visions and personal identity 
development. 


- Houston Groups 


- National CM of Color 
Summits 


- Alumni mentorship 
program 


PART THREE: Professional Development Catalog 


PART FOUR: IMPORTANT DATES AND ONGOING EXPECTATIONS 


Source: Teach for America, 2017. 
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Appendix B: Summary of Research Studies 


Table B-1. Summary of Research Studies on Teach for America, 1 of 2 


Name of Study 


Supplying Disadvantaged 
Schools with Effective 
Teachers: Experimental 
Evidence on Secondary 
Math Teachers from Teach 
for America 


The Effectiveness of 
Secondary Math Teachers 
from Teach for America 
and the Teaching Fellows 
Programs 


Impacts of the Teach for 
America Investing in 
Innovation Scale-Up 


Does Teacher Preparation 
Matter? Evidence About 
Teacher Certification, 
Teach for America, and 
Teacher Effectiveness 


The Effects of Teach for 
America on Students: 
Findings from a National 
Evaluation 


Teacher Characteristics 
and Student Achievement: 
Evidence from Teach for 
America 


Teach for America 
Teachers: How Long Do 
They Teach? Why Do They 
Leave? 


PNT tate) a) 


Chiang, H. S., Clark, 
M. A., & McConnell, 
Ss 


Clark, M. A., Chiang, 
H. S., Silva, T., 
McConnell, S., 
Sonnenfeld, K., Erbe, 
A., & Puma, M. 


Clark, M. A., 
Isenberg, E., Lui, A. 
Y., Makowsky, L., & 
Zukiewicz, M. 


Darling-Hammond, 
L., Holtzman, D. J., 
Gatlin, S. J., & 
Vasquez Heilig, J 


Decker, P. T., Mayer, 
D. P., & Glazerman, 
S. 


Dobbie, W. 


Donaldson, M. L., & 
Johnson, S. M. 


Year of 
Publication 


2017 


2013 


2017 


2005 


2004 


2011 


2011 


Findings 


This study found that TFA teachers were more effective than 
more experienced non-TFA teachers with more than five years 
of experience in the same schools in math, increasing student 
math achievement by 0.07 standard deviations over one school 
year. 


On average, secondary students assigned to TFA teachers 
scored 0.07 standard deviations higher on end-of-year math 
assessments than students assigned to comparison teachers. 


This report examined the effectiveness of TFA first and second 
year corps members in the second year of a federally funded 
scale-up grant. Compared to other teachers, TFA teachers 
were more likely to come from selective colleges, but have less 
experience in teaching. On reading and math end-of-year tests, 
student performance outcomes, on average, for students 
assigned to TFA teachers was not statistically different from 
those assigned to teachers in the comparison group. 


This multiple longitudinal analyses of student test scores 
showed that, when controlling for teacher experience, degrees, 
and student characteristics, uncertified TFA teachers are less 
effective than certified teachers, and similarly effective to non- 
TFA uncertified teachers during the first two to three years of 
teaching. 


This study compared student outcomes of students assigned to 
TFA teachers and non-TFA teachers on norm referenced 
assessments, TFA students received significantly higher 
average math scores compared to non-TFA students. There 
was no significant difference in reading score between groups. 
While the majority of TFA teachers graduated from competitive 
undergraduate programs, they were less likely to have received 
education specific training compared to control teachers. 


This study reported that TFA teachers’ prior achievement, 
leadership experience, and perseverance was associated with 
student gains in math, student gains in English, and improved 
student behavior in the classroom. Researchers argue that 
applicants’ characteristics and accomplishments at the time of 
hire can predict student outcomes. 


This study found that most TFA corps members continued to 
teach after their two-year commitment. Over 60 percent of 
teachers remained in the classroom schools longer than two 
years, and more than one third taught for more than four years. 
Researchers argue that TFA teachers leave for reasons similar 
to other teachers (e.g., working conditions, employment 
opportunities). 
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Table B-1 continued. Summary of Research Studies on Teach for America, 2 of 2 


Name of Study 


Author(s) 


Year of 


lmlaretiare by 


Examining Spillover 
Effects from Teach for 
America Corps Members 
in Miami-Dade County 
Public Schools 


Teach for America: A 
Return to the Evidence 


What Does Certification 
Tell Us About Teacher 
Effectiveness? Evidence 
From New York City 


The Effectiveness of 
“Teach for America" and 
Other Under-Certified 
Teachers 


Teach for America: An 
Evaluation of Teacher 
Differences and Student 
Outcomes in Houston, 
Texas 


Making a Difference? The 
Effects of Teach for 
America in High School 


Hansen, M., Backes, 
B., Brady, V., & Xu, 
Z. 


Heilig, J. V., & Jez, S. 


J. 


Kane, T. J., Rockoff, 
J. E., & Staiger, D. O. 


Laczko-Kerr, I., & 
Berliner, D. C. 


Raymond, M., 
Fletcher, S. H., & 
Luque, J 


Xu, Z., Hannaway, J., 
& Taylor, C. 


Publication 


2014 


2014 


2008 


2002 


2001 


2011 


This study examined the spillover effect of large clusters of TFA 
teachers on other teachers’ performance in schools in Miami- 
Dade County. Researchers were not able to find evidence of 
spillover, but did report evidence of higher average 
performance on math test scores of 10 percent of a standard 
deviation for students assigned to TFA teachers. 


This meta-evaluation offers analysis of studies on the 
effectiveness of TFA teachers. It addresses areas of impact, 
such as student achievement, teacher attrition, and cost of 
TFA, with strong criticism regarding the absence of peer- 
reviewed articles that support TFA. Researchers provide 
recommendations to improve TFA, including a call for five-year 
contractual commitments to hiring districts and cost-benefit 
analysis comparisons across multiple hiring districts. 


This study found that the certification status of a teachers had 
small impacts on student performance. Researchers argue that 
high turnover groups, like TFA, would only have to be slightly 
more effective in their two years of teaching to offset negative 
effects of exit rates. 


This study found that students of certified teachers performed 
significantly better on the SAT 9 in reading, math, and language 
arts, compared to students of uncertified teachers. Further 
analysis of uncertified teachers, by TFA and non-TFA, showed 
no significant impact on student performance. 


This study found that students of TFA teachers, on average, 
outperformed students in teacher comparison groups. However, 
the difference in average performance was statistically 
significant for only two out of the six models. This study also 
reported less variation in the quality of TFA hires compared to 
non-TFA hires. 


This multiple longitudinal analyses of student test scores 
showed that students of TFA teachers performed better than 
students of non-TFA teachers, regardless of certification status. 
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Appendix C: Campuses with TFA Corps Members 


Table C-1. HISD Schools with Hired TFA Corps Members, 2012-2013 through 2016-2017, 1 of 2 


Dogan ES 
Houston MSTC. 


Braeburn ES 


The Rusk School 
Woodson School 


1 
Fondren MS 5 
Garcia ES 3 
Henry MS 3 
Lewis ES 1 
Sharpstown HS 2 
Sugar Grove Academy 1 
3 
3 


Black MS 


Brookline ES 4 7 
Cunningham ES 2 8) 
Gallegos ES 1 6 
Grissom ES 2 5) 
Harris, JR ES 2 9 
Hartman MS u 
Heights HS 1 10 
Herrera ES 3 a 
Lantrip ES 2 5 
Marshall ES 3 7 
Rodriguez ES 2 7 
Stevens ES 1 5 
Wainright ES 4 9 
Wisdom HS 2 a 


Bonham ES 
Burbank ES 
Cage ES 
Codwell ES 
Crespo ES 
Davila ES 
DeAnda ES 
Lawson MS 
Elmore ES 
Emerson ES 
Foerster ES 
Kashmere HS 
Madison HS 
Marshall MS 
Neff ECC 

Neff ES 
Northline ES 
Ortiz MS 

Pugh ES 
Sharpstown International School 
Shearn ES 
Stevenson MS 
Welch MS 


NOATBRDONAWANANNATATATWWAW A 


Sources: TFA Cohort List, 2012-2013, 2013-2014, 2014-2015, 2015-2016, 2016-2017 
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Table C-1 continued. HISD Schools with Hired TFA Corps Members, 2012-2013 through 2016-2017, 2 of 2 


Attucks MS 1 
Austin HS 1 
Benavidez ES 2 
Bonner ES 3 
Coop ES 4 
Deady MS 
Durham ES 
EL DAEP 
Eliot ES 
Fondren ES 
Fonville MS 2 
Franklin ES 2 
Garden Villas ES 3 
Gregory-Lincoln MS 1 
Hamilton MS 1 
Harris, RP ES 
Highland Heights ES 4 1 
Hilliard ES i 
Hogg MS 
Houston Academy for International Studies 2 
Jefferson ES 1 
Jones HS 2 

Kelso ES 1 
Key MS 1 
Mandarin Immersion Magnet School 1 
McReynolds MS 1 
Moreno ES 2 
Oates ES 1 
Petersen ES 4 
Pilgrim Academy 5 
Port Houston ES 1 
Project Chrysalis MS 5 1 
Reagan K-8 Ed Center 1 

Revere MS 1 
Robinson ES i 
Scarborough ES 1 
Scroggins ES 1 
Smith ES 1 
Sutton ES 1 
Thomas MS 1 
Valley West ES 3 
Walnut ES 1 
Wesley ES 3 

Wheatley HS 1 
Whittier ES 1 
Williams MS 2 
Yates HS 1 


Sources: TFA Cohort List, 2012-2013, 2013-2014, 2014-2015, 2015-2016, 2016-2017 


= 32a -34p 


= 


a 


= 
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Appendix D: New Teacher Data 


Table D-1. Teacher Retention Rates of New Teacher Cohorts by Teach for America (TFA) and Non-Teach for America 


(Non-TFA), 2012-2013 through 2017-2018 


2012-2013 Cohort 
N=1,246 


2013-2014 Cohort 
N=1,370 


2014-2015 Cohort 
N=1,313 


2015-2016 Cohort 
N=1,234 


2016-2017 Cohort 
N=927 


TFA 
n=123 
Non-TFA 
n=1,123 
TFA 
n= 104 
Non-TFA 
n= 1,266 
TFA 
n= 101 
Non-TFA 
n= 1,212 
TFA 
n= 49 
Non-TFA 
n= 1,185 
TFA 
n= 38 
Non-TFA 
n= 889 


109 


929 


89% 


83% 


Sources: HR Roster File 2014-2015, 2015-2016, 2016-2017; and TFA Cohort File, 2014-2015, 2015-2016, 2016-2017 
Notes: Percentages may not equal 100 due to rounding. In 2012-2013, 2014-2015, and 2016-2017, the number of teachers hired 
did not match the number of teachers employed as of November 1 of the respective year. 


HISD Research and Accountability 23 


TEACH FOR AMERICA PROGRAM EVALUATION, 2017 


Table D-2. Demographic Characteristics of New Teacher Cohorts by Teach for America (TFA) and Non-Teach for America Teachers (Non-TFA), 2014-2015 through 2016-2017 


% of % of New 
Non-TFA | Teachers 


% of New 
Teachers 


% of % of New 
Non-TFA_| Teachers 


% of New 
Teachers 


% of % of New 
Non-TFA Teachers 


% of New 
Teachers 


% of TFA Frequency 


% of TFA Frequency 


Frequency Frequency 


Frequency | % of TFA Frequency 


Race/Ethnicity 


Unknown 


Asian 


Black/African American 


Hispanic/Latino 
White 
Other 

Gender 


Unknown 


Female 
Male 
Level of Education 


No Degree/Unavailable 


Bachelors 


Masters or Higher 
Sources: HR Roster File 2014-2015, 2015-2016, 2016-2017; PEIMS Roster File 2014-2015, 2015-2016, 2016-2017; and TFA Cohort File, 2014-2015, 2015-2016, 2016-2017 
Notes: Percentages may not equal 100 due to rounding. Data for level of education for new teachers in 2016-2017 was not available for this report. In 2014-2015 and 2016-2017, the number of 

teachers hired did not match the number of teachers employed as of November 1 of the respective year. 
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Table D-3. HISD Placement of New Teacher Cohorts by Teach for America (TFA) and Non-Teach for America Teachers (Non-TFA), 2014-2015 through 2016-2017 


Frequency 


% of TFA 


% of New 
Teachers 


Frequency 


% of New 
Teachers 


% of New 
Teachers 


% of New 
Teachers 


% of New 
Teachers 


% of New 
Teachers 


Frequency | % of TFA Frequency 


Frequency | % of TFA Frequency 


Placement by School Accountability 
Rating 


Not Rated/Unknown 


Met Standard 


Improvement Required 


Placement by Critical Shortage 
Assignment 


Unknown 


Critical Shortage Area 


Non-Critical Shortage Area 


Placement by School Level 


Unknown 


Elementary 


Middle 


High 


Combined 


Placement by School % 
Economically Disadvataged 
Students 


Unknown 


Lower than 60% 


60% to 69% 


70% to 79% 


80% to 89% 


Higher than 90% 


Placement by Student Population 


Unknown 


Regular Education 


Bilngual/ESL 


Compensatory 


Gifted and Talented 


Career and Technical Education 


Special Education 


Other 


Sources: HR Roster File 2014-2015, 2015-2016, 2016-2017; PEIMS 
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Roster File 2014-2015, 2015-2016, 2016-2017; and TFA Cohort File, 2014-2015, 2015-2016, 2016-2017 
Notes: Percentages may not equal 100 due to rounding. Data for placement by student population for new teachers in 2016-2017 was not available for this report. In 2014-2015 and 2016-2017, the 
number of teachers hired did not match the number of teachers employed as of November 1 of the respective year. 
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Table D-4. Instructional Practice Ratings of Teachers Retained Annually by Teach for America (TFA) and Non-Teach 
for America Teachers (Non-TFA), 2014—2015 through 2016-2017 


N= 889 
Sources: HR Roster File 2014-2015, 2015-2016, 2016-2017; TADS F&D Tool, 2014-2015, 2015-2016, 2016-2017; and TFA 
Cohort File, 2014-2015, 2015-2016, 2016-2017 
Notes: Percentages are based on the retention rate for the year. Percentages may not equal 100 due to rounding. In 2014-2015 
and 2016-2017, the number of teachers hired did not match the number of teachers employed as of November 1 of the 
respective year. 
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Table E-1. HISD Teacher Appraisal and Development System 


Summative 
Measure Rating Criteria for Measurement 
Weight 
Planning (PL) 50% PL-1 Develops student learning goals 
OR PL-2 Collects, tracks, and uses student data to drive 
instruction; 
70% PL-3 Designs effective lesson plans, units, and 
assessments 
Instruction (I) | -1 Facilitates organized, student-centered, objective-driven 
lessons 
|-2 Checks for student understanding and responds to 
student misunderstanding 
|-3 Differentiates instruction for student needs by employing 
a variety of instructional strategies 
I-4 Engages students in work that develops higher-level 
thinking skills 
1-5 Maximizes instructional time 
1-6 Communicates content and concepts to students 
1-7 Promotes high expectations for students 
1-8 Students actively participating in lesson activities 
1-9 Sets and implements discipline management 
procedures 
1-10 Builds a positive and respectful classroom environment 
; . 5 
ee SST au ue See the HISD Teacher Appraisal and Development System: 
30% Instructional Practice and Professional Expectations Rubrics 
i for more information. 
Student 30% 
Performance OR See the HISD Student Performance Guidebook for more 
(PR) N/A information. 


Sources: HISD Performance Management, 2013; HISD Performance Management, 2015; HISD Performance Management, 2017 
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Appendix F: Results from the 2016 HISD 
Principal Interest Survey regarding Teach for America 


Table F-1. Responses from the Principal TFA Interest Survey, 2016-2017 (N=46) 


Are you a TFA Corps Member? 


Have you previously hired a 1st year TFA Corps Member? 


Considering the follow ing: The premium rate for corps members is $5000 per year for a critical 
shortage teacher (Bilingual, Secondary ELAR, Secondary Math or Secondary Science) and 
$3000 per year for all other content area teachers. Is your campus willing to budget for TFA 
corps members for tw 0(2) years beginning the upcoming 2017-2018 school year? 


Oto1 yr 
| 


13 39.4 6 18.2 
Two 


PAOKB EC) 


lf you have previously hired a TFA corps member, how long have you been working with 
Teach for America corps members in your capacity as principal? 


If you are willing to hire a TFA corps member, how many are you interested in hiring? 


4to5yrs 


| | | 


More than 5 yrs Total 


More than two Total 


Source: HISD Human Resources Department, TFA Principal Interest Survey, 2017 


Table F-2. Sample Principal Responses to the Open-Ended Item, “What additional feedback would you like to provide 


regarding Teach For America and our continued partnership? 


Sample Responses 


"Although [it is] hard to staff [our] campus, our extreme budgeting limitations makes it difficult to utilize programs such as TFA." 


"With already limited funding, it is difficult to hire and train a TFA Corp member to only stay for 2 years and then leave. If |amto pay extra for TFA Corp 
member, then it has to be for a longer guarantee than 2 years. The effort in training a TFA'er is more difficult than a traditional teacher. The payout is 
not worth the rew ard in my opinion." 


"|currently don't have vacancies but if they come up | w ould definitely consider TFA." 


"We have had some good luck and some bad with our TFA corps members. Even ones that turned out really well had very rough beginnings and took 
much coaching (as most beginning teachers do.) How ever, it is rare to have one that stays in education in the classroom. The money coupled with 
the time expenditure for training makes them less than ideal candidates, despite the fact that they are quality candidates. " 


"Our hiring is based on if we have openings. At this point we may or not have openings in specific fields. We are also looking for more Spanish 
speaking corps members who can communicate w ith parents w hen possible." 


"My campus is small and never has the number of required vacancies needed. | believe TFA only places CMs on campuses in groups. | have requested 
to have one in the past and promised to support that one, but it has not been an option. Now that | know there is a fee involved, | am not able to do so 
because of funding." 


"We have had a great experience with TFA and want to continue our partnership." 


"| w ould like to w ork with TFA, but | do not expect to have additional funding to cover this expense." 


al ( 
Tot ( 


Source: : HISD Human Resources Department, TFA Principal Interest Survey, 2017 
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